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EXTENDED ACTIVE DISTURBANCE 
REJECTION CONTROLLER 


CROSS-REFERENCE TO RELATED 
APPLICATIONS 

This application claims the benefit of U.S. Application No. 
60/965,359 filed 20 Aug. 2007. This application is a continu- 
ation in part and claims the benefit of the following applica- 
tions: U.S. application Ser. No. 12/067,141 filed 17 Mar. 
2008; that claims priority to the following: Patent Coopera- 
tion Treaty Appl. No. PCT/US2006/036156, filed 18 Sep. 
2006; U.S. Appl. No. 60/718,393, filed 19 Sep. 2005; U.S. 
Appl. No. 60/718,581, filed 19 Sep. 2005; U.S. Appl. No. 
60/718,899, filed 20 Sep. 2005; U.S. Appl. No. 60/728,928, 
filed 20 Oct. 2005; and U.S. Appl. No. 60/728,929 filed, 20 
Oct. 2005; and U.S. application Ser. No. 10/351,664 filed, 27 
Jan. 2003 that claims priority to U.S. Appl. No. 60/373,404, 
filed 18 Apr. 2002. 

This work was supported at least in part by NASA under 
NASA contract number GT3 -5 23 87. Accordingly, the United 
States government may have certain rights herein. 

TECHNICAL FIELD 

The subject matter described herein relates to controllers, 
systems, and methods for feedback control of various sys- 
tems. 

BACKGROUND 

A feedback (closed-loop) control system 10, as shown in 
Prior Art FIG. 1, is widely used to modify the behavior of a 
physical process, denoted as the plant 110, so it behaves in a 
specific desirable way over time. For example, it may be 
desirable to maintain the speed of a car on a highway as close 
as possible to 60 miles per hour in spite of possible hills or 
adverse wind; or it may be desirable to have an aircraft follow 
a desired altitude, heading and velocity profile independently 
of wind gusts; or it may be desirable to have the temperature 
and pressure in a reactor vessel in a chemical process plant 
maintained at desired levels. All of these industrial tasks are 
accomplished today by using traditional feedback control, 
and the above are examples of what automatic control sys- 
tems are designed to do, without human intervention. 

The key component in a feedback control system is the 
controller 120, which determines the difference between the 
output “y” of the plant 110, (e.g., the temperature or position) 
and its desired value, and produces a corresponding control 
signal “u” (e.g., modulating the power input to a heater or 
motor). 

The goal of controller design is to make the difference 
between the actual output of the plant and the desired output 
as small as possible as rapidly as possible. Today, controllers 
are employed in a large number of industrial control applica- 
tions and in areas like robotics, aeronautics, astronautics, 
motors, motion control and thermal control, just to name a 
few. 

INDUSTRIAL APPLICABILITY 

The present system and method has potential applicability 
to a wide range of different industrial and commercial appli- 
cations. The following brief synopsis is intended only to 
provide background on some exemplary applications to assist 
a person of ordinary skill in the art in understanding this 


Classic Control Theory provides a number of techniques 
for an engineer to use in controller design. Existing control- 
lers for linear, time invariant, and single-input single-output 
plants are categorized in one taxonomy into three forms: the 
proportional/integral/derivative (PID) controllers, transfer 
function based (TFB) controllers, and state feedback (SF) 
controllers. The PID controller is defined by the equation: 

u =K P e+Kj§e+K D e Equation (1) 

where (u) is the control signal and (e) is the error between the 
set point and the process output (y) being controlled. As 
commonly used, the notation of a dot (•) above a variable 
indicates the use of a derivative of the variable where the order 
corresponds to the number of dots. 

The PID-type of controller has been employed in engineer- 
ing and other applications since the early 1920s. It is an 
error-based controller that does not require an explicit math- 
ematical model of the plant 110. 

Transfer Function Based Controller 

The transfer function based (TFB) controller is given in the 
form of 


U(s) = G c (s)E(s ) Equation (2) 


where U(s) and E(s) are Laplace Transforms of u and e 
defined above, and n(s) and d(s) are polynomials in s. The 
TFB controller can be designed using methods in control 
theory based on the transfer function model of the plant, 
Gp(s). A PID controller can be considered a special case of a 
TFB controller because it has an equivalent transfer function 
of s. 


State Feedback (SF) Controller 

The State Feedback (SF) controller can be defined by 

u=r+Kx Equation (4) 

where u is the control input, r is the setpoint for the output to 
follow and x is the state vector associated with the system, 
based on the state space model of the plant 110: 

x(t)=Ax(t)+Bu(f) Equation (5) 

y(t)=Cx(t)+Du{t) Equation (6) 

where x(t) is the state vector, y(t) is the output vector, u(t) is 
the input or control vector, A is the state matrix, B is the input 
matrix, C is the output matrix and D is the feed-through 
matrix. When the state x is not accessible, a state observer 
(SO): 

x =Ax+Bu+L (y-y) Equation (7) 

is usable to estimate the state x, where the Q symbol is used 
to denote an estimate or observed value of a given variable 
and L denotes the observer coefficient matrix. 
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disclosure more fiilly. Additional background information on 
a select number of exemplary industrial applications are also 
provided. 

BACKGROUND OF THE INVENTION 
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State Observers 

Observers extract real-time information of a plant’s 110 
internal state from its input-output data. The observer usually 
presumes precise model information of the plant 110 , since 
performance is largely based on its mathematical accuracy. 
Most prior art closed loop controllers require both types of 
information. Such presumptions, however, often make the 
method impractical in engineering applications, since the 
challenge for industry remains in constructing these models 
as part of the design process. Another level of complexity is 
added when gain scheduling and adaptive techniques are used 
to deal with nonlinearity and time variance, respectively. 
Disturbance Observers and Disturbance Rejection 

Recently, disturbance rejection techniques have been used 
to account for uncertainties in the real world and successfully 
control complex nonlinear systems. The premise is to solve 
the problem of model accuracy in reverse by modeling a 
system with an equivalent input disturbance d that represents 
any difference between the actual plant P and a derived/ 
selected model P w of the plant, including external distur- 
bances w. An observer is then designed to estimate the dis- 
turbance in real time and provide feedback to cancel it. As a 
result, the augmented system acts like the model P M at low 
frequencies, making the system behave like P M and allowing a 
controller to be designed for P w . 

The most common of these techniques is the disturbance 
observer (DOB) structure (Endo, S., H. Kobayashi, C J. 
Kempf, S. Kobayashi, M. Tomizuka and Y. Hori (1996). 
“Robust Digital Tracking Controller Design for High-Speed 
Positioning Systems.” Control Eng. Practice, 4:4, 527-536; 
Kim, B. K., H.-T. Choi, W. K. Chung and I. H. Suh (2002). 
“Analysis and Design of Robust Motion Controllers in the 
Unified Framework.” / of Dynamic Systems, Measurement, 
and Control, 124, 313-321; Lee, H. S. and M. Tomizuka 
(1996). “Robust Motion Controller Design for High- Accu- 
racy Positioning Systems.” IEEE Trans. Ind. Electron., 43:1, 
48-55; Tesfaye, A., H. S. Lee and M. Tomizuka (2000). “A 
Sensitivity Optimization Approach to Design of a Distur- 
bance Observer in Digital Motion Control.” IEEE/ASME 
Trans, on Mechatronics, 5:1, 32-38; Umeno, T. andY. Hori 
(1991). “Robust Speed Control of DC Servomotors Using 
Modern Two Degrees of-Freedom Controller Design”. IEEE 
Trans. Ind. Electron., 38:5, 363-368). It uses a disturbance 
observer consisting of a binomial Q-filters and the inverse 
model of the plant. And the controller is called parameterized 
in the sense that the Q-filter is treated as a parameter. A model 
deliberately different from P is suggested in E. Schrijver and 
J. Van Dijk, “Disturbance Observers for Rigid Mechanical 
Systems: Equivalence, Stability, and Design,” Journal of 
Dynamic Systems, Measurement, and Control , vol. 124, no. 4, 
pp. 539-548, 2002 to facilitate design, but no guidelines are 
given other than it should be as simple as possible, while 
cautioning stability and performance may be in danger if the 
model is significantly different from the plant. Another 
obstacle is that a separate state observer must be designed to 
provide state feedback to the controller. In existing research, 
derivative approximates are used in this way but their effect 
on performance and stability is questionable. Furthermore, 
the controller design is dependent on the DOB design, mean- 
ing that derivative approximates can not be arbitrarily 
selected. 

Multiple DOBs were used to control a multivariable robot 
by treating it as a set of decoupled single-input single-output 
(SISO) systems, each with disturbances that included the 
coupled dynamics (Bickel, R. and M. Tomizuka (1 999). “Pas- 
sivity-Based Versus Disturbance Observer Based Robot Con- 
trol: Equivalence and Stability.”/, of Dynamic Systems, Mea- 
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surement, and Control, 121, 41-47; Hori, Y., K. Shimura and 
M. Tomizuka (1992). “Position/Force Control of Multi-Axis 
Robot Manipulator Based on the TDOF Robust Servo Con- 
troller For Each Joint.” Proc. of ACC, 753-757; Kwon, S. J. 

5 and W. K. Chung (2002). “Robust Performance of the Mul- 
tiloop Perturbation Compensator.” IEEE/ASME Trans. 
Mechatronics, 7:2, 190-200; Schrijver, E. and J. Van Dijk 
(2002) Disturbance Observers for Rigid Mechanical Systems 
Equivalence, Stability, and Design.” J. of Dynamic Systems, 

10 Measurement, and Control, 124, 539-548.) 

Another technique, referred to as the unknown input 
observer (UJIO), estimates the states of both the plant and the 
disturbance by augmenting a linear plant model with a linear 
disturbance model (Burl, J. B. (1999). Linear Optimal Con- 
15 trol, pp. 308-3 14. Addison Wesley Longman, Inc., California; 
Franklin, G. F., J. D. Powell and M. Workman (1998). Digital 
Control of Dynamic Systems , Third Edition, Addison Wesley 
Longman, California; Johnson, CD. (1971). “Accommoda- 
tion of External Disturbances in Linear Regulator and Servo- 
20 mechanism Problems.” IEEE Trans. Automatic Control, 
AC- 16:6, 635-644; Liu, C-S, and H. Peng (2002). “Inverse- 
Dynamics Based State and Disturbance Observer for Linear 
Time-Invariant Systems.” J. of Dynamic Systems, Measure- 
ment, and Control, 124, 375-381 ; Profeta, J. A. Ill, W. G. Vogt 
25 and M. H. Mickle (1 990). “Disturbance Estimation and Com- 
pensation in Linear Systems.” IEEE Trans. Aerospace and 
Electronic Systems, 26:2, 225-231; Schrijver, E. and J. Van 
Dijk (2002) “Disturbance Observers for Rigid Mechanical 
Systems: Equivalence, Stability, and Design.” / of Dynamic 
30 Systems, Measurement, and Control, 124, 539-548). Unlike 
the DOB structure, the controller and observer can be 
designed independently, like a Luenberger observer. How- 
ever, it still relies on a good mathematical model and a design 
procedure to determine observer gains. An external distur- 
35 bance w is generally modeled using cascaded integrators 
(l/s^). When they are assumed to be piece-wise constant, the 
observer is simply extended by one state and still demon- 
strates a high degree of performance. 

Extended State Observer (ESO) 

40 In this regard, the extended state observer (ESO) is quite 
different. Originally proposed by Han, J. (1999). “Nonlinear 
Design Methods for Control Systems.” Proc. \4th IFAC 
World Congress , in the form of a nonlinear UIO and later 
simplified to a linear version with one tuning parameter by 
45 Gao, Z. (2003). “Scaling and Parameterization Based Con- 
troller Tuning .’’Proc. of ACC, 4989-4996, the ESO combines 
the state and disturbance estimation power of a UIO with the 
simplicity of a DOB. One finds a decisive shift in the under- 
lying design concept as well . The traditional observer is based 
50 on a linear time-invariant model that often describes a non- 
linear time-varying process. Although the DOB and UIO 
reject input disturbances for such nominal plants, they leave 
the question of dynamic uncertainty mostly unanswered. The 
ESO, on the other hand, addresses both issues in one simple 
55 framework by formulating the simplest possible design 
model P rf =l/s" for a large class of uncertain systems. The 
design model is selected to simplify controller and 
observer design, forcing P to behave like the design model P^ 
at low frequencies rather than P„. As a result, the effects of 
60 most plant dynamics and external disturbances are concen- 
trated into a single unknown quantity. The ESO estimates this 
quantity along with derivatives of the output, giving way to 
the straightforward design of a high performance, robust, 
easy to use and affordable industrial controller. 

65 Active Disturbance Rejection Control (ADRC) 

Originally proposed by Han, J. (1999). “Nonlinear Design 
Methods for Control Systems.” Proc. \4th IFAC World Con- 
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gress , a nonlinear, non-parameterized active disturbance 
rejection control (ADRC) is a method that uses an ESO. A 
linear version of the ADRC controller and ESO were param- 
eterized for transparent tuning by Gao, Z. (2003). “Scaling 
and Parameterization Based Controller Tuning” Proc. of 5 
ACC, 4989-4996. Its practical usefulness is seen in a number 
of benchmark applications already implemented throughout 
industry with promising results (Gao, Z., S. Hu and F. Jiang 
(2001). “A Novel Motion Control Design Approach Based on 
Active Disturbance Rejection.” Proc. of 40th IEEE Confer- 10 
ence on Decision and Control: ; Goforth, F. (2004). “On 
Motion Control Design and Tuning Techniques.” Proc. of 
ACC ; Hu, S. (2001). “On High Performance Servo Control 
Solutions for Hard Disk Drive.” Doctoral Dissertation, 
Department of Electrical and Computer Engineering, Cleve- 15 
land State University; Hou, Y., Z. Gao, F. Jiang and B. T. 
Boulter (2001). “Active Disturbance Rejection Control for 
Web Tension Regulation.” Proc. of 40th IEEE Conf. on Deci- 
sion and Control ; Huang, Y., K. Xu and J. Han (2001). “Flight 
Control Design Using Extended State Observer and Nons- 20 
mooth Feedback.” Proc. of 40 th IEEE Conf on Decision and 
Control ; Sun, B and Z. Gao (2004). “A DSP-Based Active 
Disturbance Rejection Control Design for a 1 KW H-Bridge 
DC-DC Power Converter.” IEEE Trans, on Ind. Electronics ; 
Xia, Y., L. Wu, K. Xu, and J. Han (2004). “Active Disturbance 25 
Rejection Control for Uncertain Multivariable Systems With 
Time-Delay., 2004 Chinese Control Conference. It also was 
applied to a fairly complex multivariable aircraft control 
problem (Huang, Y., K. Xu and J. Han (2001). “Flight Control 
Design Using Extended State Observer and Nonsmooth 30 
Feedback. Proc. of 40 th IEEE Conf on Decision and Control). 

What is needed is a control framework for application to 
systems throughout industry that are complex and largely 
unknown to the personnel often responsible for controlling 
them. In the absence of required expertise, less tuning param- 35 
eters are needed than current approaches, such as multi-loop 
PID, while maintaining or even improving performance and 
robustness. 

INDUSTRIAL APPLICATION 40 

A selection of industrial applications is presented herein to 
provide a background on some selected applications for the 
present extended active disturbance rejection controller, 
Tracking Control 45 

Tracking Control refers to the output of a controlled system 
meeting design requirements when a specified reference tra- 
jectory is applied. Oftentimes, it refers to how closely the 
output y compares to the reference input r at any given point 
in time. This measurement is known as the error e=r-y. 50 

Control problems are categorized in two major groups; 
point-to-point control and tracking control. Point-to-point 
applications usually call for a smooth step response with 
small overshoot and zero steady state error, such as when 
controlling linear motion from one position to the next and 55 
then stopping. Since the importance is placed on destination 
accuracy and not on the trajectory between points, conven- 
tional design methods produce a bandwidth limited controller 
with inherent phase lag in order to produce a smooth output. 
Tracking applications require a good tracking of a reference 60 
input by keeping the error as small as possible at all times, not 
just at the destination. This is particularly common in con- 
trolling a process that never stops. Since the importance is 
placed on accurately following a changing reference trajec- 
tory between points, phase lags are avoided as much as pos- 65 
sible because they may lead to significant errors in the tran- 
sient response, which lasts for the duration of the process in 
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many applications. A common method of reducing phase lag 
is to increase the bandwidth, at the cost of increased control 
effort (energy) and decreased stability margin. 

Various methods have been used to remove phase lag from 
conventional control systems. All of them essentially modify 
the control law to create a desired closed loop transfer func- 
tion equal to one. As a result, the output tracks the reference 
input without much phase lag and the effective bandwidth of 
the overall system is improved. The most common method is 
model inversion where the inverse of the desired closed loop 
transfer function is added as a prefilter. Another method pro- 
posed a Zero Phase Error Tracking Controller (ZPETC) that 
cancels poles and stable zeros of the closed loop system and 
compensates for phase error introduced by un-cancelable 
zeros. Although it is referred to as a tracking controller, it is 
really a prefilter that reduces to the inverse of the desired 
closed loop transfer function when unstable zeros are not 
present. Other methods consist of a single tracking control 
law with feed forward terms in place of the conventional 
feedback controller and prefilter, but they are application 
specific. However, all of these and other previous methods 
apply to systems where the model is known. 

Model inaccuracy can also create tracking problems. The 
performance of model-based controllers is largely dependent 
on the accuracy of the model. When linear time-invariant 
(LTI) models are used to characterize nonlinear time- varying 
(NTV) systems, the information becomes inaccurate over 
time. As a result, gain scheduling and adaptive techniques are 
developed to deal with nonlinearity and time variance, 
respectively. However, the complexity added to the design 
process leads to an impractical solution for industry because 
of the time and level of expertise involved in constructing 
accurate mathematical models and designing, tuning, and 
maintaining each control system. 

There have been a number of high performance tracking 
algorithms that consist of three primary components: distur- 
bance rejection, feedback control, and phase lag compensa- 
tion implemented as a prefilter. First, disturbance rejection 
techniques are applied to eliminate model inaccuracy with an 
inner feedback loop. Next, a stabilizing controller is con- 
structed based on a nominal model and implemented in an 
outer feedback loop. Finally, the inverse of the desired closed 
loop transfer function is added as a prefilter to eliminate phase 
lag. Many studies have concentrated on unifying the distur- 
bance rejection and control part, but not on combining the 
control and phase lag compensation part, such as the RIC 
framework. Internal model control (IMC) cancels an equiva- 
lent output disturbance. B. Francis and W. Wonham, “The 
Internal Model Principal of Control Theory,” Automatica, vol 
12, 1976, pp. 457-465. E. Schrijver and J. Van Dijk, “Distur- 
bance Observers for Rigid Mechanical Systems: Equiva- 
lence, Stability, and Design,” Journal of Dynamic Systems, 
Measurement, and Control , vol. 124, December 2002, pp. 
539-548 uses a basic tracking controller with a DOB to con- 
trol a multivariable robot. The ZPETC has been widely used 
in combination with the DOB framework and model based 
controllers. 

Thus, having reviewed prior art in tracking control, the 
application now describes example systems and methods of 
tracking control employing predictive ADRC. 

Web Processing Applications 

Web tension regulation is a challenging industrial control 
problem. Many types of material, such as paper, plastic film, 
cloth fabrics, and even strip steel are manufactured or pro- 
cessed in a web form. The quality of the end product is often 
greatly affected by the web tension, making it a crucial vari- 
able for feedback control design, together with the velocities 
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at the various stages in the manufacturing process. The ever- 
increasing demands on the quality and efficiency in industry 
motivate researchers and engineers alike to explore better 
methods for tension and velocity control. However, the highly 
nonlinear nature of the web handling process and changes in 
operating conditions (temperature, humidity, machine wear, 
and variations in raw materials) make the control problem 
challenging. 

Accumulators in web processing lines are important ele- 
ments in web handling machines as they are primarily respon- 
sible for continuous operation of web processing lines. For 
this reason, the study and control of accumulator dynamics is 
an important concern that involves a particular class of prob- 
lems. The characteristics of an accumulator and its operation 
as well as the dynamic behavior and control of the accumu- 
lator carriage, web spans, and tension are known in the art. 

Both open-loop and closed-loop methods are commonly 
used in web processing industries for tension control pur- 
poses. In the open-loop control case, the tension in a web span 
is controlled indirectly by regulating the velocities of the 
rollers at either end of the web span. An inherent drawback of 
this method is its dependency on an accurate mathematical 
model between the velocities and tension, which is highly 
nonlinear and highly sensitive to velocity variations. Never- 
theless, simplicity of the controller outweighs this drawback 
in many applications. Closing the tension loop with tension 
feedback is an obvious solution to improve accuracy and to 
reduce sensitivity to modeling errors. It requires tension mea- 
surement, for example, through a load cell, but is typically 
justified by the resulting improvements in tension regulation. 

Most control systems will unavoidably encounter distur- 
bances, both internal and external, and such disturbances 
have been the obstacles to the development of high perfor- 
mance controller. This is particularly true for tension control 
applications and, therefore, a good tension regulation scheme 
must be able to deal with unknown disturbances. In particular, 
tension dynamics are highly nonlinear and sensitive to veloc- 
ity variations. Further, process control variables are highly 
dependent on the operating conditions and web material char- 
acteristics. Thus, what are needed are systems and methods 
for control that are not only overly dependent on the accuracy 
of the plant model, but also suitable for the rejection of sig- 
nificant internal and external disturbances. 

Jet Engine Control Applications 

A great deal of research has been conducted towards the 
application of modern multivariable control techniques on 
aircraft engines. The majority of this research has been to 
control the engine at a single operating point. Among these 
methods are a multivariable integrator windup protection 
scheme (Watts, S. R. and S. Garg (1996). “An Optimized 
Integrator Windup Protection Technique Applied to a Turbo - 
fan Engine Control,” AIAA Guidance Nacyigation and Con- 
trol Conj !), a tracking filter and a control mode selection for 
model based control (Adibhatla S. and Z. Gastineau (1994). 
“Tracking Filter Selection And Control Mode Selection For 
Model Based Control.” AIAA 30th Joint Propulsion Confer- 
ence and Exhibit.), an H m method and linear quadratic Gaus- 
sian with loop transfer recovery method (Watts, S. R. and S. 
Garg (1995).” A Comparison Of Multivariable Control 
Design Techniques For A Turbofan Engine Control.” Inter- 
national Gas Turbine and Aeroengine Congress and Expo?), 
and a performance seeking control method (Adibhatla, S. and 
K. L. Johnson (1993). “Evaluation of a Nonlinear Pse Algo- 
rithm on a Variable Cycle Engine.” AIAA/SAE/ASME/ASEE 
29th Joint Propulsion Conference and Exhibit .). Various 
schemes have been developed to reduce gain scheduling 
(Garg, S. (1997). “A Simplified Scheme for Scheduling Mul- 
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tivariable Controllers.” IEEE Control Systems) and have even 
been combined with integrator windup protection and H m 
(Frederick, D. K., S. Garg and S. Adibhatla (2000). “Turbofan 
F Engine Control Design Using Robust Multivariable Control 
5 Technologies. IEEE Trans, on Control Systems Technology). 

Conventionally, there have been a limited number of con- 
trol techniques for full flight operation (Garg, S. (1997). “A 
Simplified Scheme for Scheduling Multivariable Control- 
lers.” IEEE Control Systems ; and Polley, J. A., S. Adibhatla 
to and P J. Hoffman (1988). “Multivariable Turbofan Engine 
Control for Full Conference on Decision and Control Flight 
Operation.” Gas Turbine and Expo). However, there has been 
no development of tuning a controller for satisfactory perfor- 
mance when applied to an engine. Generally, at any given 
15 operating point, models can become inaccurate from one 
engine to another. This inaccuracy increases with model com- 
plexity, and subsequently design and tuning complexity. As a 
result, very few of these or similar aircraft design studies have 
led to implementation on an operational vehicle. 

20 The current method for controlling high performance jet 
engines remains multivariable proportional -integral (PI) con- 
trol (Edmunds, J. M. (1979). “Control System Design Using 
Closed-Loop Nyquist and Bode Arrays.” Int. J on Control, 
30:5, 773-802, and Polley, J. A, S. Adibhatla and P J. Hoff- 
25 man (1 988) . “Multivariable Turbofan Engine Control for Full 
Conference on Decision and Control. Flight Operation.” Gas 
Turbine and Expo). Although the controller is designed by 
implementing Bode and Nyquist techniques and is tunable, a 
problem remains due to the sheer number of tuning param- 
30 eters compounded by scheduling. 

SUMMARY OF INVENTION 

The present system, method, process, and device for con- 
35 trolling systems is applicable for a variety of different appli- 
cation and has utility in a number of different industrial fields . 
The following brief summary section is provided to facilitate 
a basic understanding of the nature and capabilities of the 
present system and method. This summary section is not an 
40 extensive nor comprehensive overview and is not intended to 
identify key or critical elements of the present systems or 
methods or to delineate the scope of these items. Rather this 
brief summary is intended to provide a conceptual introduc- 
tion in simplified form as an introduction for the more 
45 detailed description presented later in this document. 

The present application describes selected embodiments of 
the ADRC controller that comprise one or more computer 
components, that extend, build upon and enhance the use of 
ADRC controllers and provide enhanced performance and 
50 utility. Specifically, in one aspect the ADRC controller uti- 
lizes a predictive computer component or module that in one 
embodiment predicts future values of the plant output and in 
a second embodiment predicts future estimates of the system 
state and generalized disturbance. The generalized distur- 
55 bance includes dynamics of the plant itself such that the plant 
is effectively reduced to a cascaded integral plant. In the 
various embodiments a variety of estimates are available and 
introduced. 

In still another aspect, the ADRC controller further 
60 includes a model of the plant dynamics. The model is used in 
one embodiment to improve the state estimator or predictor. 
In a second embodiment the model is used to provide an 
enhanced control law that provides improved performance. In 
both aspects of the embodiments discussed in this paragraph, 
65 the generalized disturbance captures model errors and dis- 
crepancies and allows the system to eliminate errors caused 
by model errors, discrepancies, and assumptions. In the mul- 
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tiple embodiments, a variety of models are available for use 
by one of ordinary skill in the art to achieve the desired 
performance relative to the type of plant being controlled. 

In yet another aspect, the ADRC controller further includes 
a non-linear, or discrete time optimal control law. The non- 5 
linear control law of the present embodiment utilizes non- 
linear control laws to improve the overall performance of an 
ADRC controller as compared to an ADRC controller with a 
linear proportional -derivative based control law. 

In still another aspect, additional knowledge of derivative 10 
plant output gathered from high quality sensor information or 
direct measurement sensors (e.g. velocity and acceleration 
sensors) is used to reduce the order of the system state and 
disturbance estimator. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying figures depict multiple embodiments of 
a device and method for the separation of constituents from a 
flow. A brief description of each figure is provided below. 20 
Elements with the same reference numbers in each figure 
indicate identical or functionally similar elements. Addition- 
ally, the left -most digit(s) of a reference number identifies the 
drawings in which the reference number first appears. 

FIG. 1 is a block diagram of a Prior Art feedback controller. 25 

FIG. 2 is a block diagram of an ADRC configuration for a 
2nd order plant. 

FIG. 3 is a block diagram of a predictive ADRC configu- 
ration. 

FIG. 4 is a block diagram of a 2 degree of freedom transfer 30 
function based (TFB) control structure. 

FIG. 5 is a block diagram of an implementation of a 
PADRC configuration based on output prediction. 

The present invention is described with reference to block 
diagrams and operational flow charts. It is to be understood 35 
that the functions/acts noted in the blocks may occur out of 
the order noted in the operational illustrations. For example, 
two blocks shown in succession may in fact be executed 
substantially concurrently or the blocks may sometimes be 
executed in the reverse order, depending upon the function- 40 
ality/acts involved, including for example executing as asyn- 
chronous threads on a processor. Although some of the dia- 
grams include arrows on communication paths to show a 
primary direction of communication, it is to be understood 
that communication may occur in the opposite direction to the 45 
depicted arrows. 

DETAILED DESCRIPTION 

Multiple embodiments of a system, device, and method for 50 
the control of systems are presented herein. Those of ordinary 
skill in the art can readily use this disclosure to create alter- 
native embodiments using the teaching contained herein. 
Lexicon 

The following terms used herein have the meanings as 55 
follows. As used herein the term “computer component” 
refers to a computer and elements of a computer, such as 
hardware, firmware, software, a combination thereof, or soft- 
ware in execution. For example, a computer component can 
include by way of example, a process running on a processor, 60 
a processor, an object, an executable, an execution thread, a 
program, and a computer itself. One or more computer com- 
ponents can in various embodiments reside on a server and 
the server can be comprised of multiple computer compo- 
nents. One or more computer components are in some cases 65 
referred to as computer systems whereby one or more com- 
puter components operate together to achieve some function- 
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ality. One or more computer components can reside within a 
process and/or thread of execution and a computer compo- 
nent can be localized on one computer and/or distributed 
between two or more computers. 

“Software”, as used herein, includes but is not limited to, 
one or more computer readable and/or executable instruc- 
tions that cause a computer or other electronic device to 
perform functions, actions and/or behave in a desired manner. 
The instructions may be embodied in various forms like rou- 
tines, algorithms, modules, methods, threads, and/or pro- 
grams. Software may also be implemented in a variety of 
executable and/or loadable forms including, but not limited 
to, a stand-alone program, a function call (local and/or 
remote), a servelet, an applet, instructions stored in a memory, 
part of an operating system or browser, and the like. It is to be 
appreciated that the computer readable and/or executable 
instructions can be located in one computer component and / 
or distributed between two or more communicating, co-op- 
erating, and/or parallel processing computer components and 
thus can be loaded and/or executed in serial, parallel, mas- 
sively parallel and other manners. It will be appreciated by 
one of ordinary skill in the art that the form of software may 
be dependent on, for example, requirements of a desired 
application, the environment in which it runs, and/or the 
desires of a designer/programmer or the like. 

“Computer communications”, as used herein, refers to a 
communication between two or more computers and can be, 
for example, a network transfer, a file transfer, an applet 
transfer, an email, a hypertext transfer protocol (HTTP) mes- 
sage, a datagram, an object transfer, a binary large object 
(BLOB) transfer, and so on. A computer communication can 
occur across, for example, a wireless system (e.g., IEEE 
802.1 1), an Ethernet system (e.g., IEEE 802.3), a token ring 
system (e.g., IEEE 802.5), a local area network (LAN), a wide 
area network (WAN), a point-to-point system, a circuit 
switching system, a packet switching system, and so on. 

An “operable connection” is one in which signals and/or 
actual communication flow and/or logical communication 
flow may be sent and/or received. Usually, an operable con- 
nection includes a physical interface, an electrical interface, 
and/or a data interface, but it is to be noted that an operable 
connection may consist of differing combinations of these or 
other types of connections sufficient to allow operable con- 
trol. 

As used herein, the term “signal” may take the form of a 
continuous waveform and/or discrete value(s), such as digital 
value(s) in a memory or register, present in electrical, optical 
or other form. 

The term “controller” as used herein indicates a method, 
process, or computer component adapted to control a plant 
(i.e. the system to be controlled) to achieve certain desired 
goals and objectives. 

As used herein the following symbols are used to describe 
specific characteristics of the variable. A variable with a “"” 
overtop the variable label, unless other indicated to the con- 
trary, indicates that the variable is an estimate of the actual 
variable of the same label. A variable with a “” overtop the 
variable label, unless otherwise indicated, indicates that the 
variable is an nth derivative of that variable, where n equals 
the number of dots. 

To the extent that the term “includes” is employed in the 
detailed description or the claims, it is intended to be inclusive 
in a manner similar to the term “comprising” as that term is 
interpreted when employed as a transitional word in a claim. 

To the extent that the term “or” is employed in the claims 
(e.g., A or B) it is intended to mean “A or B or both”. When the 
author intends to indicate “only A or B but not both”, then the 
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author will employ the term “A or B but not both”. Thus, use 
of the term “or” in the claims is the inclusive, and not the 
exclusive, use. 

Active Disturbance Rejection Control (ADRC) 

Active Disturbance Rejection Control (“ADRC”) is a 
method or process and, when embedded within a computer 
system, a device (i.e., a controller that processes information 
and signals using the ADRC algorithms), that effectively 
rejects both unknown internal dynamics of a system of an 
arbitrary order to be controlled, or plant 110, and external 
disturbances in real time without requiring detailed knowl- 
edge of the plant 110 dynamics, which is required by most 
existing control design methods. 

The only information needed to configure an ADRC con- 
troller is knowledge of the relative order of the plant 110 and 
the high frequency gain of the plant 110. In comparison, 
traditional model-based control methods require accurate 
mathematical models to conform with prevailing model- 
based design methods. In some embodiments, the ADRC 
controller leverages knowledge gained from model-based 
controller designs to improve control performance. The 
ADRC approach is unique in that it first forces an otherwise 
nonlinear, time- varying and uncertain plant 110 to behave as 
a simple linear cascade integral plant that can be easily con- 
trolled. To this end, the unknown, nonlinear, and time- varying 
internal dynamics is combined with the external disturbances 
to form what is denoted as the generalized disturbance, which 
is then estimated and rejected, thus greatly simplifying the 
control design. 

The embodiments of the ADRC controller design are 
founded on the basic theory that uncertainties in dynamics 
and unknown external disturbances in the operating environ- 
ment are a key challenge to be dealt with in control engineer- 
ing practice. Traditional control systems are incapable of 
providing a solution to controlling and mitigating the impact 
of these uncertainties. The ADRC controller in contrast is 
specifically adapted to mitigate and eliminate the impact of 
these uncertainties, thus providing a dynamically simplified 
system for control. 

One previous major characteristic of the ADRC controller 
is the parameterization of the controller as a function of 
control loop bandwidth. This parameterization makes all of 
the ADRC controller parameters functions of the control loop 
bandwidth; see, U.S. patent application Ser. No. 10/351,664, 
titled, “Scaling and Parameterizing A Controller” to Zhiqiang 
Gao, which is hereby incorporated by reference in its entirety. 

An embodiment of a parameterized ADRC controller 
applied to a second-order plant 202 is illustrated in FIG. 2. 
The system to be controlled is a second-order plant 202 and 
represents an arbitrary plant 110 with predominantly second- 
order dynamics. The second-order plant 202 has an output (y) 
in response to an input that comprises a control signal (u) with 
superimposed external disturbances (d). 

Consider a general uncertain, nonlinear and time-varying 
second-order plant 202 of the form: 

y=f(y,y,d,t)+bu Equation (8) 

where y is system output, u is the control signal, b is a 
constant, d is external input disturbance, f(y,y, d, t) is treated 
as the generalized disturbance. When this generalized distur- 
bance is cancelled, the system is reduced to a simple double- 
integral plant with a scaling factor b, which can be easily 
controlled. Here we assume that the approximate value of b, 
denoted as b, is given or estimated. As shown in FIG. 2, the 
scaling factor (b) is used to scale 208, the control output (uft). 
In other embodiments, the scaling factor is implicit within the 
linear PD control law 206. 
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To capture the information of the generalized disturbance 
f (y,y,d,t) and cancel it from the system dynamics leads us to 
the Extended State Observer (ESO) 204, which is now pre- 
sented. Let x 2 =y; andx 3 =j J , the description of the above 
5 plant 202 is rewritten in state space form with f (y,y,d,t), or 
simply f, treated as an additional state: 


(x = A x x + B x u + Ef Equation (9) 

10 t y = C x x 

where 



0 

1 

O' 


O' 


'O' 

A x = 

0 

0 

1 

, B x = 

b 
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0 
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0 
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The corresponding state observer is 

20 

( Z = A X Z + B Z U + IXy m - c x z) Equation (10) 

\f=Vz 

25 where y m is the measured system output, B z =[0 b 0] r , V=[0 0 
1], and L=[\ 1 1 2 l 3 ] r is the observer gain vector. With the 
parameterization technique as described more fully in U.S. 
patent application Ser. No. 1 0/35 1 ,664, L is obtained by solv- 
ing the equation X(s)=lsI-A x +LC x l=(s+oo 0 ) 3 ; that is, all the 

30 eigenvalues of the observer are placed at -oo 0 with 

/ 1 =3(0^/ 2 =3(i) <:) 2 ,/3=(0 o 3 Equation (11) 

With a well-tuned extended state observer 204, z l , z 2 and z 3 
will closely track y, y, and f respectively, i.e. z x «y, z 2 «y, and 

35 z 3 «f. 

Using the information provided by the extended state 
observer 204, the generalized disturbance f is rejected by the 
control law 

u=(u 0 -z 3 )/b Equation (12) 

40 

which reduces the plant 110 to a unity gain, double integral 
plant 

y=u Q Equation (13) 

45 that can be easily controlled with linear proportional -deriva- 
tive (PD) with feedforward 

u 0 =g pd (e,e,<ti c )+r Equation (14) 

where g^e^oo^) is the parameterized linear PD controller 

with the loop bandwidth of ou 

50 r 

gpj<e, e, to J=(O c 2 e+2(O c e Equation (15) 

with the error term defined as 

e=r-z i e=r-z 2 Equation (16) 

55 where the desired trajectory (r) is provided by the user. 

Note that the linear PD control law 206 in Equation (14) 
corresponds to the common PD gains of 

k p =i o c 2 and k d =2(i> c Equation (17) 

60 Using these details, the ADRC controller is generalized in 
its various embodiments to control an arbitrary n^ -order sys- 
tem y Cw) =;f(y,y, . . . , y (w_1) ,d,t)+bu, in which the external 
disturbances and unknown internal dynamics are rejected. In 
a similar manner, the plant 110 is reduced to a cascaded 

65 integral plant y (w) =u, which is then controlled by a general- 
ized proportional -derivative (PD) control law, also described 
as a linear PD control law 206 similar to Equation (14). 
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Use of Enhanced Sensor Infonnation to Improve Control 
Performance 

In other embodiments of the ADRC controller, the linear 
PD control law 206 is updated to enhance performance by 
using direct measurement of the system output states (y m ) 5 
instead of the estimated states (z l5 z 2 ). Specifically, when the 
measured output y m (t) is sufficiently noise free and y m (t) is 
obtainable, either via direct measurement or from y m (t), the 
control law in Equation (14) can be implemented with 

e = r-y m e =r-y m Equation (18) 

That is, the output measurement and its derivative are used 
in the control law, instead of their estimates, z 1 and z 2 . Simi- 
larly for the n^-order plant 110, the output measurement y m 15 
and its derivatives from the 1 st to the (n- 1 -order available, 
can also be used directly in the PD control law, also referred 
to as the linear PD control law 206, instead of their estimates 
from the Extended State Observer (ESO) 204. Using the 
direct measurement of the output measurement state Y, and its 20 
derivatives reduces the phase lag and improve control system 
performance, if the output measurement and its derivatives 
are not corrupted by noise. 

Multiple Extended States 

The Extended State Observer 204 in alternative embodi- 
ments includes more than one extended states, such as 
embodiments where the 2nd order plant 202 is replaced with 
a higher order plant 110. In one embodiment, when aug- 
mented with two extended states, x 3 =;f and x 4 =^j, the 30 
extended plant state space model can be written as follows. 


j x = A x x + B x u + Ef 

\y = c x x 

where 



Equation (19) 


35 


40 


45 

With z l5 z 2 , z 3 , and z 4 tracking x l5 x 2 , x 3 , and x 4 respec- 
tively, the 4^-order ESO 204 is employed to estimate f. 


(Z = A x z + B z u 4- L{y m - C x z) 

\f = vz 

where 

B z = [ 0 b 0 of and V = [0 0 1 0], 


Equation (20) 


50 


55 


In this manner, any embodiment of an ADRC controller is 
adaptable for use with an arbitrary number (h) extended state 
observer states with is generalized to control an n^ -order 
system. 60 

Discrete Implementation 

ADRC algorithms are implemented in discrete time, with 
ESO 204 discretized in both Euler and ZOH, and in both the 
current estimator and predictive estimator form. 

In discrete implementation, the ESO 204 pole location is 65 
determined in the Z domain by solving the equation X(z)=l zl- 
(|)+L^C x l=(z-p) 3 , where (3=e _co ° r . 
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Predictive Discrete Extended State Observer (PDESO) is 
in predictive estimator form, as shown in the following equa- 
tion. 


(z[k + 1] = &z[k] + r u[k\ + L p (y m [k ] - zi El) Equation (21) 

\z[k] = z[k] 

Current Discrete Extended State Observer (CDESO) is in 
current estimator form, as shown in the following equation. 


( Z[k + 1] = ®z[k] + r u[k ] + L p ( y m [k] - Zi El) Equation (22) 

1 z[k] = z[k] + L c (y m [k] - zi [k]) 


The gain matrices of different ADRC discrete implemen- 
tations are shown in the following Table I. 


TABLE I 



PDESO AND CDESO COEFFICIENT MATRICES 

Type 

r L p L c 


Euler 

1 T 0 


' 0 ' 


3(1 -P) 


i -ys 3 


0 1 T 


bT 


3(1-/J) 2 /T 


(1-/J) 2 (2 + /J)/T 


. 001 . 


. 0 . 


(1-/J) 3 /T\ 


(1-/J) 3 /T 2 


ZOH 

T 2 

1 T — 


„T 2 

b— 


3(1 -P) 


1-ys 3 


2 


2 


3(1-/J) 2 (5 + 


3(1-/J) 2 (1+/J)/2T 


0 1 T 
0 0 1 


bT 


0/2T 


(1-/J) 3 /T 2 




0 


(1-/J) 3 /T 2 



This discrete implementation of ADRC is also generaliz- 
able to n^-order plants 110. 

Predictive Active Disturbance Rejection Controller 

The thrust of the many of the embodiments presented here 
is the addition of the predictive functions to extend the capa- 
bilities of the original components of the ADRC. This extends 
the ADRC controller and generates embodiments of predic- 
tive versions of the ADRC, such as the predictive ADRC 300, 
depicted in block diagram form in FIG. 3 In this embodiment, 
the linear PD control law 206 in the predictive ADRC 300 is 
now a predictive control law 306. Similarly, the observer, or 
more specifically the extended state observer 204 from the 
traditional ADRC 200 is now embodied as a predictive state 
and disturbance observer 3 04 . In one embodiment the predic- 
tive state and disturbance observer 304 is a predictive 
extended state observer (PESO) where the prediction occurs 
within the bounds of the ESO 204 to where the estimated 
states z w (t) are predicted to form the predictive state and 
disturbance observer 304, and outputs the prediction of the 
estimated states z„(t+r). In a second embodiment, a state 
predictor method is used to extend the design of the ESO 204 
to estimate the states z„(t) and form the predictive state and 
disturbance observer 304. 

In other embodiments, other estimators and predictors, 
either in an integrated form or in combination are used to 
generate similar information as that generated by the predic- 
tive state and disturbance observer 304 and used by the 
embodiments predictive ADRC 300. One of these other 
embodiments adopts a disturbance observer (DOB) estimator 
structure to estimate the disturbance and a state observer and 
a predictor element that together form the predictive state and 
disturbance observer 304. In a second other embodiment, the 
predictive state and disturbance observer 304 utilizes an 
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unknown input observer (UIO) estimator. Other estimators, 
including combinations of estimators such as the combina- 
tion of a state observer and a DOB, are suitable for estimation 
of both the plant 110 output and the known part of the general 
disturbance (;f w ) are adaptable using the disclosure provided 
herein to those of ordinary skill in the art to serve as a pre- 
dictive state and disturbance observer 304. 

The challenge in constructing the various embodiments of 
a predictive controller within the general purpose ADRC 
controller architecture is how the various signals used by the 
ADRC algorithm are predicted and used. The signals used by 
the ADRC algorithm originate from a multitude of sources in 
the various embodiments, including in one embodiment the 
extended state observer 204 (ESO). In another embodiment, a 
simplified, reduced-order ESO (RESO) is used when either: 
(i) quality measurements of the output signals allows numeri- 
cal differentiation to estimate derivatives of the output signal; 
or (ii) direct measurement of derivatives are possible (e.g. 
velocity and acceleration sensors), are available. 

In another embodiment, a nonlinear proportional -deriva- 
tive (NPD) control law is used to further optimize the perfor- 
mance of the present ADRC system. The RESO aspect of the 
ADRC controller provides alternative embodiments of ESO 
204 and RESO; a general form of RESO with multiple 
extended states for an lY-order plant 110, and incorporation 
of the known plant 110 dynamics into ESO 204 and control 
law. 

Furthermore, to facilitate practical implementations of the 
new techniques, we have provided at selected locations 
herein, the transfer function equivalent predictive ADRC 400, 
with H(s) 402 and G c (s) 404, in a two-degree-of-freedom 
(2dof) structure shown in FIG. 4. Similarly, for a transfer 
function equivalent predictive ADRC 400, the plant dynamics 
are represented as G (s) 402. For various forms of the Pre- 
dictive ADRC 400 described herein, these transfer function 
expressions, together with the NPD and RESO, are novel and 
significant even when the amount of prediction is set to zero. 

All of these new developments help, to make the predictive 
ADRC 300 possible and to provide the means of implemen- 
tation the present embodiments in a diverse range of indus- 
trial machinery, and they are illustrated in details in the fol- 
lowing sections. 

Basic Design Principles for Predictive ADRC 

In the real world, the sensor feedback, the generation of the 
control signal and its arrival at the actuator, and the estimation 
of the states and disturbances all contain time delays and 
phase lags, which can endanger system stability. To accom- 
modate such delays and lags, we propose the following Pre- 
dictive ADRC control law: 

u it) = igi Equation (23) 

where g(e,e,oo c ) is the parameterized linear PD controller 206, 
or nonlinear proportional derivative (NPD) controller, Equa- 
tion (68), l e , 1^, 1 M , and 1^ are positive real numbers represent- 
ing the prediction horizons, a special case of which is 
l c =l 6 =l„=ljs=T and the corresponding control law is 

u{t)={g{e(t+x),e{t+x),<^ c )+r(t+x)-^(t+x))lb Equation (24) 

Also, if a part of the plant 110 dynamics, is given, it can 

be incorporated into ADRC, as shown later in this disclosure. 
In the context of Predictive ADRC 300, the knowledge of j n 
can be used to help predict its future value, f„(t+lf ). The 
corresponding control law for Equation (23) and Equation 
(24) are 

«(O=(^e(r+/J,e(?+/J,coJ+r(?+/J-0„(r+y-f„(r+ 

Equation (25) 

and 

u{t)=(g(e(t+T),e(t+T),<ti c )+r{t+x)-$ n (t+x)-$ u (t+x))lb Equation (26) 

respectively. 


Described below are various methods to obtain the predic- 
tion of e(t), e(t), and f(t), respectively, so that these predictive 
ADRC 300 control laws can be implemented. 

Prediction of e and e 

5 Two embodiments of methods for predicting the values of 
error e(t) and its derivative are presented herein. 

Method 1 : Using Taylor Series, the prediction of e(t), e(t) 
can be obtained as 


to 

e(t + l e ) = e(t ) + e{t)l e or 

e(t) 

e{t + l e )=e{t) + e{t)l e + —l 2 e . 


and e(t+l 6 )=e(t)+e(t)l 6 . Here e(t) can be obtained directly 
from r-y, or from r-z 2 using regular ESO, or r-z 1 using 
RESO. Here e(t) can be obtained as e(t)=f(t)-y(t)«r(t)-(z 3 
(t)+bu(t)) with ESO or e(t)=r(t)-y(t)«r(t)-(z 2 (t)+bu(t)) with 
RESO. 

Method 2: Since e(t+x)=r(t+x)-z 1 (t+x) and e(t+x)=r(t+x)- 
z 2 (t+x), e(t+x) and e(t+x) can be obtained directly using the 
future reference signals r(t+x) and r (t+x) which are generally 
known, and the predicted output of the ESO z x (t+x) and 
z 2 (t+x), which need to be obtained approximately. 

Prediction of f in ESO and RESO 

The primary method of predicting j is the I st or 2” rf -order 
Taylor Series approximation, i.e. 


3° 

+ 1 / ) * /(0 + /( 0 */. or 

fit + If) * fit) + }(t)l f + 
35 


Equation (27) 


Equation (28) 


which requires the 1 st and/ or 2 nd order derivatives of jf. To this 
end, a new form and a new way of implementation of 
extended state observer (ESO) 204 are introduced first, fol- 
lowed by the discussion on how to use them to obtain the 
predicted estimate of j in Equation (27) and Equation (28) 
Reduced-Order ESO 

In the observer-based control methods, the phase lag intro- 
duced by the observer decreases the phase margin of the 
45 control loop and is therefore undesired. To reduce the phase 
lag in the ESO 204, an embodiment of a reduced-order ESO 
(RESO) described here. 

Consider the plant 202 in Equation (9), if the derivative of 
the measured output y m (y m ) is given, a RESO can be con- 
structed with z l and z 2 estimating x 2 =y and x 3 =f respectively. 
5 0 The correspondence between the augmented plant state space 
model and the RESO is shown as follows. 


Equation (29) 


55 

'oio' 


"o' 


"o' 

x = 

00.1 

x + 

m 

u + 

0 


[om\ 


$ 


.1. 


y = [ 10 0]x 


\i 

to' 

z\ 


m 


V 

Zl . 

[ii 

T 2 . 

+ 

M. 

u + 

h m 


f= [0 l]z 


65 The shadowed blocks show how the gain matrices of the 
RESO are obtained from the augmented plant state space 
model. Equivalently, the RESO can be represented as 
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Z = A z z 4- B z u + L(y m - C z z ) 
f = Vz 


Equation (30) 


' 4 i' 

0 

1 ■ 

■*r 

r°i r/.i 






M . " 

" .0 

0 . 

M. 

[ b [ h . 


Equation (37) 


\Z3= \hiy m -Zi)dt 


r° i] 

\b ] r6i 


. B r = . L= . 

o 

o 

o 


Cz = [l 0 ], V = [ 0 1], 


and l 1 =2oo 0 , l 2 =oo 0 2 . 

With RESO replacing the ESO 204, the corresponding 
linear PD control law 206 in ADRC 400 is 


£e,e,<s> c )+r-z 2 )/b 


e= r ~y m , e = r ~z l 


e=r-y m ,e=r-y m 


The first part is a Luenberger observer for the double inte- 
gral plant in Equation (1 3), and the second part shows that the 
10 estimation of the general disturbance can be obtained by 
integrating the observer error with a gain of 1 3 . This imple- 
mentation is equivalent to the ESO 204. 

When implemented in ZOHI current estimator form, the 
Luenberger observer is 


Equation (31) 


Equation (32) 


If y m is clean it can be also fed back into the control law 
instead of z l5 the Equation (33) changes to 


Equation (34) 


Note here that the parameterized linear PD control law 206 
can be replaced by the parameterized NPD control law 506, 
which will be introduced later. 

The order of ESO 204 is reduced further if y is also given, 
as the double derivative of y m . According to U.S. patent 30 
application Ser. No. 10/351,664, the total disturbance is 
obtained as x 3< f=y-bu and it is susceptible to measurement 
noise. In an alternative embodiment, a first order RESO can 
be constructed with the only state z tracking x 3 =j\ The cor- 
respondence between the augmented plant state space model 35 
and the new RESO is shown as follows. 


| Z [k + 1] = + Yu[k] + Lp(y m [k] - zi [k]) 

\m=m+L c (y m [k]-zm) 


Equation (38) 


1-02 I 
(1+02-2 0i)IT\ 
2 - 2/3 1 1 

(1+02-200/tI 


Pi = cT^cos fa=e 


Similarly, the RESO in Equation (30) can be divided into 
two parts: 


010 0 0 . 

x = 0 0 1 x + b u+ 0 f 

.oof] m U. 

y = [ 10 0]x 

Z = + Wp + 1 (y m - bu - z ) 

f=z 

The shadowed blocks show how the gain matrices of the 
RESO are obtained from the augmented plant state space 
model. Equivalently, the RESO can be represented as 


Z = A z z + B z u + L(y m - bu- C z z) 
f = Vz 


| zi =bu + k(y m -zi) 

I zi — [h(y m -zi)dt 


Equation (39) 


where the first part is a first order Luenberger observer, and 
the second part is an integrator. When implemented in ZOH 
current estimator form, this Luenberger observer is 


Equation (35) 


where A z =0, B z =0, L=l=oo 0 , C z =l, V=l. The corresponding 
linear PD control law 206 with this RESO is 

iHgp/e,e,(£> e )+r-z)lh Equation (36) 6Q 

where e=r-y m , e=r-y m . Note here again that the parameter- 
ized linear PD control law 206 can be replaced by the param- 
eterized NPD control law 506 to be introduced. 

A New ESO Implementation 

Consider the same second-order plant 202 as described in 65 
Equation (9). The ESO 204 described in U.S. patent applica- 
tion Ser. No. 10/351,664 can be divided into two parts. 


Equation (40) 


(zi [k + 1 ] = <t> Zl [k] + Yum + Lpiy m rn - * m 
U [k]=zdk] + L c {y m [k]-z l [k]) 

where 

<I> = 1, T = bT, L c = Lp = 1 - 0, and 0 = e~^° T . 


Prediction of fj 

With the new implementation of ESO 204, J=jl 3 (y m -z 1 )dt, 

^(y^-Zi) and Jf=l 3 (y m -z 2 ), and this enables us to deter- 
mine ^(t+l^) based on the 1^ or 2”^-order Taylor series 
approximation shown in 


' h(y m -Zi)dt + l f l 3 (y m -zi) 


Equation (41) 



US 8,180,464 B2 


19 

-continued 


/ l 2 l 3 Equation (42) 

h(y m -zi)dt + lfl 3 (y m -zi)+ -^(y m -Zi) 


With RESO, J(t+lf) is obtained as 

S(t+lf)^!l 2 (y m -zi)dt+l f l 2 (y m - z i) Equation (43) 

Equivalent 2dof Transfer Functions with Prediction in ESO 
Using prediction in ESO 204, with the l^-order Taylor 
series approximation of future value of j used in control law 
404, the equivalent 2dof transfer functions are 


Ifhs 3 4 - (kph + kdl 2 + h)P + 
1 {kph + kdh)s 4 - kyh 

^ t? s3 + (h + kd)s 2 + 

(h +k P +k d h ~ ifh) s 


{s 3 + hs 2 + h$ 4 " h){s^ 4 " kdS 4 - kp ) 
Ifhs 3 4 - {kph + kdh 4 - h) s2 4 - 

{k p h + kdh)s + kih 


Equation (44) 


Equation (45) 


where \ l , u, u are observer gains defined in Equation (11) and 
and k d are the proportional -derivative (PD) gains defined in 
Equation (17). 

When the 2 m/ - order Taylor series approximation of j is 
used in control law 404, the equivalent 2dof transfer functions 
are 


4 f. . lfhh) 3 
—s +(/// 3 +— y 


^ 2 + k p 


+ kdh - If 1 3 - 


4 - 

fyih 


I s 


tf CO = ■ 


( 5 ^ 4 - hs 2 4 - h$ 4 " h){s 2 4 - kdS 4 - kp ) 
{kph + kdh 4 - h) s2 4 - {kph 4 - kdh) s 4 " k\h 


Equation (46) 


1 {kph 4" kdh 4" 4- (AU 2 4- kdh)s 4- /ci /3 

C(i)= s TET^T 

5 +yh+kd — 2~r 


Equation (47) 


Equivalent 2dof Transfer function with Prediction in RESO 
The equivalent 2dof transfer functions of ADRC-RESO 
with prediction in f are as follows. 


Ijh^ 3 + (^p 4 kdh 4" h )^ 2 4" 
1 {kph +kdh) s 4- kph 
b s 2 + {k d + h ~lfh)s 


{s 2 4 - 4 - h){kp 4 " kdS 4 - 5 ^) 

Ifh^ 3 4 - {kp 4 - kdh 4 " h)s 2 4 ” 


{kph 4” k d h) s 4” kph 


Equation (48) 


Equation (49) 


where 1 15 1 2 are observer gains defined in Equation (35). 
State Predictor Method for Predictive Extended State 
Observer 

Another embodiment for forming a predictive state and 
disturbance observer 304 module is to use a state predictor 
method to extend the performance of a baseline ESO 204 to 
predict state estimates xseconds in the future. The basic state 


20 

predictor method approach was published by T. Oguchi, H. 
Nijmeijer, Prediction of Chaotic Behavior , IEEE Trans, on 
Circuits and Systems — I, Vol. 52, No. 11, pp. 2464-2472, 
2005, which is hereby incorporated by reference. The state 
5 predictor method is combined in the embodiments presented 
herein with the regular ESO 204 of the form 


10 


Z = Az + Bu + L{y - J) 

y = Cz 

where 



0 

0 


'O' 

A = 

0 0 1 

, B = 

b 

15 

0 

0 

0 


. 0 . 
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Equation (50) 


Equation (51) 


to form the predictive ESO is in the form of 

z{t)=Az{t)+Bu{t)+L(y{t)-y{t)) 

25 

y{t)=Cz{t-x) Equation (52) 

Then y(t)=Zj (t-x) will track y(t) while z x (t)=y(t+x) is its 
prediction x seconds ahead. The ideas is that since the 
observer design ensures that the observer error goes to zero, 
30 or becomes very small, if that error is defined as the difference 
between y(t) and z^t-x) and z^t-x) will approach y(t) and 
z x (t) will approach y(t+x). Therefore Zj(t) can be used as a 
prediction of y(t)x second ahead. 

Building a Predictive State and Disturbance Observer Using 
35 an Output Prediction Mechanism 

Perhaps a simpler method to obtain z(t+x) is to leave the 
observer unchanged but replace its input y m (t) with the pre- 
dicted output y(t+x) as shown in FIG. 5. This configuration is 
used both to obtain the predicted error and its derivatives as 
40 well as the predicted disturbance estimation. Also depicted in 
FIG. 5 is a prediction module computer component or more 
generally a prediction module 508. The prediction module 
508 is adapted to accept the measured system output (y m (t)) 
and calculated estimated values of the system output (y(t+x)) 
45 from the present time to a time (x) in the future. 

A state and disturbance observer 504, shown in FIG. 5, 
accepts the predicted and current values of the plant output 
(y m ) and the control commands (u(t)) to estimate the future 
estimated states (z w (t+x)) where (n) is the number of esti- 
50 mated states plus an estimate of the generalized disturbance 

The state and disturbance observer 504 in one embodi- 
ment is an ESO 204. In a second embodiment, the state and 
disturbance observer 504 is a disturbance observer (DOB) 
structure. In yet another embodiment, the state and distur- 
55 bance observer 504 is an unknown input observer (UID). It is 
apparent that the combination of the state and disturbance 
observer 504 in combination with the prediction module 508 
provides a similar output and performance a similar function 
within the framework of an output predictive ADRC control - 
60 ler 5 0 0 as the predictive state and disturbance ob server 3 04 of 
the predictive ADRC controller 300. In this manner, the vari- 
ous embodiments of the predictive ADRC controller 300 and 
output predictive ADRC controller 500 are correlated. 

Also shown in FIG. 5, a control law 506 is provided that 
65 uses the estimated future states of the plant 110 coupled with 
the desired trajectory (r (w) (t+x)) to generate a current control 
input (u(t)). The embodiment of the control law 506 depicted 
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in FIG. 5 incorporates the additive inverse of the estimated 
future values of the estimated disturbance (f n ). 

Combine the Output Prediction with Regular ESO 

To compensate for the delay, y(t) is replaced with the 5 
approximately predicted output y (t+x) as the input to the ESO 
204. Again, the approximated prediction, y(t+x), is obtained 
from the Taylor Series approximation. The 1^-order Taylor 
series approximation and the 2"^-order Taylor series approxi- 
mation of y(t+x) are as shown in the following equations to 
respectively. 


and the new RESO is constructed as 


t(t + r) = A z z(t + t) + B z u(t) + UXr + r) - C z z(t + r)) Equation (61) 
f(t + t) = Vz(t 4 - r) 


y(t + t) = y m (t) + y m (t)r 


Equation (53) 


0 

1 ■ 

m 

\h] 



. = \ 

.L=\ . 

.0 

0. 

L 0 J 


y m (r) o 

y(t + T ) = y m (t) + yjt)r + 


Equation (54) 


Then the predicted system output and the current control 20 
signal are used as the inputs to the ESO 204 as follows. 


and l 1 =2co 0 , l 2 =( 0 o 2 . which again provides the predicted state 
and disturbance estimation in z(t+x). 

Equivalent 2 dof Transfer Functions 

With the above the E'-order Taylor Series approximation 
y(t+x) is used as the input to the RESO, the equivalent 2dof 
transfer functions are: 


z(t + r) = A z z{t + r) + B z u(t) 4 - L(y(t + r) - C z z(t + r)) Equation (55) 25 

f(t + T) = V Z (t+T) 


which will provide both the predicted states and the distur- 
bance estimation in z(t+x). 30 

Equivalent 2dof Transfer Functions 

When the E*- order Taylor series approximation is used to 
obtain y(t+x), the equivalent 2dof transfer functions are 


((h + k-dh + hk p )s + 

1 ( kpl 2 + hkd)s + k p h)(l + ts) 

C(s) = - 

^ 5(5^ + (/1 + kd)s + (I2 + k p + kdh)) 


(5 + 1\S + I 2 S + + krfS + s ) 

((h + kdh + hkp)s 2 + 

{k p h + hkd)s + k p k){ 1 + tj ) 


Equation (56) 


Equation (57) 


(( k p +kdl 1 + h)s 2 + 

1 (kph + hk d )s + k p lz)(l + rs) 

C(5) = - — 

l s(s + (h + k d )) 


(s 2 + h$ + h )(k p + kdS + s 2 ) 
((kp + kdh + h) s2 + 
(kph + hkd)s + k p l 2 )(l + rs) 


Equation (62) 


Equation (63) 


Combine the Output Prediction with RESO 

With the RESO configuration, the prediction is obtained as 


When the 2 nd -order Taylor Series approximation is used to 
obtain y(t+x), the equivalent 2dof transfer functions are 


((h + kdh + hk p )s + 


1 (kph + hk d )s + k p h)^ 1 +rs+ —s L j 
b s(s 2 + (/j + k d )s + (h + k p + kdh )) 

(5 3 + hs 2 + h$ + h)(k p + kdS + s 2 ) 
((h + kdh + hk p )s 2 + (kph + hkd) s + 

k p h)[\ +TS+ 


Equation (58) 


Equation (59) 


Combine the Output Prediction with RESO 

With the RESO configuration, the prediction is obtained as 65 


y(t+x)=y(t)+y m (l)x 


and the new RESO is constructed as 


Z(t + r) = A z z(t + t) + B z u(t ) + L[y(t + r) - C z z(t 4- r)) 
f(t+T)=V Z (t + T) 


ro n b r/i 1 

A z = ,B Z = , L = 

.0 0. 0 .h. 


C z = [ 1 0 ], V = [ 0 1] 

and 

h = 2 (x) 0 , h = M o- 


Equation (64) 


Equation (65) 


y(t+*)=yJt)+y(t)T 


Equation (60) 


which again provides the predicted state and disturbance 
estimation in z(t+x). 
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Equivalent 2 dof Transfer Functions 

With the above the 1^- order Taylor Series approximation 
y(t+x) is used as the input to the RESO, the equivalent 2dof 
transfer functions are 


( {k p +k d h+ l 2 )s 2 + Equation (66) 

1 (k p li + l 2 k d )s + k p l 2 ){ 1 + rs) 
b s ( s + (h + kd)) 


24 

A General Form of Reduced-Order Multiple Extended-State 
ESO for an n^ -Order Plant 

Although the Predictive ADRC 300 has been presented 
with an ESO 204 or RESO with only one extended state, the 
same technique can be readily extended to a general n^ -order 
plant with an ESO 240 or RESO that has multiple extended 
states. To facilitate such development, we present here a gen- 
eral form of the reduced-order multiple extended states ESO 
204 for an n^-order plant of the form 
10 y^=f(y,y, ■ ■ ■ , y (n ~ l) ,d,t)+bu Equation (69) 

Let the n states be x 1 =^y, x 2 =x 1 =y, . . . , x K =x„_ 1 =y (w-1 ' ) , and 
the h extended states be x n+l =f, x w+2 =x„ +1 =j ? , . . . , 
x „+h = Xn+h-i = f^ h ~ 1) • The plant 110 in Equation (69) can now 
be expressed in the augmented form: 




Equation (68) shows that, within the region Ixl^R and 
lyl^R, this parameterized NPD control law 506 is oo c 2 e+ 
2oo c e, which is the same as the parameterized linear PD con- 
trol law 206 in Equation (15); outside this region, however, 
the NPD control law 506 is nonlinear. This new NPD control 
law 506 can be used to replace the linear PD control law 206 
in the original ADRC 200 algorithm to achieve better perfor- 
mance. In one embodiment the NPD control law 506 is used 
in conjunction with a predicted state estimate z„(t+x). In a 
second embodiment, the NPD control law 506 is uses only the 
current state estimate (z w (t). 


nonzero element in B x is in the n £h row. 

Assume that y, y, . . . , y (n+h ~ m ^ are measured or otherwise 
available as y m , y m , . . . , y m (n+h ~ m \ then the approximate 
states x l5 x 2 , . . . , x n+h _ m+l are available (If m=h, the last state 
can be obtained from its definition: x„ +1 =f=y m ( " , -bu). Also 
assume j l(w) does not change rapidly and can be handled by the 
observer. The ESO 204 order can be reduced to m, where 
h^m^n+h. With x n+h _ m+l andu as inputs, and with z l5 . . . , 
z m estimating x„ +h _ m+1 , . . . , x n+h respectively, the general 
ESO 204 form is 
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-continued 


n+h-m 

7=1 


Equation (75) 


5 


A = A** + + Ef u 

y = C x x 


, where 



V' 1 t, 'Ji+h-l-m+jxiim 

/ t ”~n+n—m+j ' 3 * j,tn 


0 

1 

O' 


- 0 ■ 

G c (s ) = 7 
b 

7=1 

A* = 

0 

0 

1 

, B x = 

b 

m-h+l 

2 k n+h - m+J s h - l *J-"<^"Sj_ l 


0 

4 

0 

-aib 


7=i 


Equation (79) 


where l^ 1 , 0<x<y. 


ADRC with Partially Known Plant Dynamics 15 

ADRC controller does not require the detail plant model 
information. However, if the whole or part of the plant 
dynamics is known, various embodiments of the ADRC con- 
troller can be modified to utilize the information to estimate 2 o 
and reject disturbance more effectively, either by control law 
modification or ESO 204 modification. With a part of the 
plant dynamics known, the known part of the generalized 
disturbance can be generated and rejected in the control law 
directly, while the rest of the generalized disturbance is esti- 25 
mated by ESO 204 and then rejected in the linear PD control 
law 206 as previously shown in the original ADRC 200 
framework. The other way to utilize the partially known plant 
dynamics is adapting the dynamics into ESO 204, where ESO 
204 still estimates the generalized disturbance. 

Consider the second-order plant 202 in Equation (8), with 
the knowledge of the plant information, part of the general- 
ized disturbance is known, denoted as f„(y,y). The rest is 
unknown part of the generalized disturbance, denoted as f u (y, 35 
y,d,t). The plant in Equation (9) can now be described as 

y = f„(y,y)+S u (y,y, d, t)+bu Equation (76) 

and there are two ways to take advantage of new information 4Q 
in SJy.y) and incorporate it into ADRC 200. One way is to 
improve ESO 204 by combining f„(x) with A x x+B x u in the 
plant space description in Equation (7 6) . The augmented state 
space form of the plant is 


and the new ESO is z=A x z+B z ii+L (y m -C x z), where B z =[0 

b-a^jC 

The other way of taking advantage of the additional infor- 
mation in ;f w (y,y) is to use it to cancel known plant dynamics 
in the control law directly. There are three ways to do this: 

u=(^{e,e,(^^)+r~y Jiy^y^-z^lb Equation (80) 

or y m and y m can be replaced by z l and z 2 in the control law, 

u=(g(e,e,<}i c )+r-y n (z l ,Z2)-z 3 )/b Equation (81) 

or y m and y m can be replaced by r and r respectively and 
rejected in the control law in a feedforward manner. 

u=(g(e,e,0) c )+r-f n (r,r)-z 3 )/b Equation (82) 

where g(e,e,oo c ) is the parameterized PD controller 206 or 
NPD controller defined in Equation (15) or Equation (68) 
respectively. Of course, any combination of the above three 
methods are available for use by one of ordinary skill in the 
art. 

INDUSTRIAL APPLICATIONS 

The present active disturbance rejection controller, and its 
associated processes, methods and devices as disclosed 
herein possesses a number of unique attributes and industrial 
applicability, including for example, utility as a controller for 
tracking control, web processing applications, and jet engine 
control applications as described in greater detail above. 

For example, in the case of tracking or motion control 
applications, the various predictive methods presented 
herein, particularly the ones that use the knowledge of the 
plant dynamics, offer reduced phase lag in the observer and 
compensate for the time delay in the plant itself, all of which 
especially benefit tracking applications that employ a desired 
output trajectory, sometimes called motion profile. 


x = A x x + Ef n (x ) + B x u + Ef u Equation (77) 

y = c x x 

50 

and the corresponding ESO 204 is 

(z = A x z + Ef n (z) + B x u + L(y m - C x z) Equation (78) 

\ „ 55 

l f = vz 

Then a new ESO 204 can be constructed to estimate the 
generalized disturbance j based on the new state space 6Q 
description of the plant 110 in Equation (77). For example, 
consider the plant y—a^+bu where a : is given, i.e. 
j ! „(y,y)=- a iy. The known part of the generalized disturbance 
is obtained from the model information: j ! „ = -a 1 y=-a 1 (-a 1 y+ 
bu). In this case where ;f w (y,y) is a linear function, the aug- 65 
mented state space representation of the plant 110 can be 
written as 


CONCLUSION 

While various embodiments of the present system and 
method for feedback control of systems have been described 
above, it should be understood that the embodiments have 
been presented by the way of example only, and not limita- 
tion. It will be understood by those skilled in the art that 
various changes in form and details may be made therein 
without departing from the spirit and scope of the invention as 
defined. Thus, the breadth and scope of the present invention 
should not be limited by any of the above described exem- 
plary embodiments. 

What is claimed is: 

1. A controller for controlling a plant, comprising: 

an input and an output associated with the plant; 

a sensor adapted to generate a sensor signal in response to 
said output; 

a predictive state and disturbance observer module, 
wherein said predictive state and disturbance observer 
module is adapted to receive said sensor signal and a 
disturbance adjusted control signal, and said module 
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30 


being further adapted to output an extended state esti- 
mate and a predicted extended state estimate, wherein 
said extended state estimate comprises a state of the 
plant, and an extended state of the plant system dynam- 
ics and external disturbances; and 5 

a control module adapted to accept said extended state 
estimate, said predicted extended state estimate, a tra- 
jectory, and a trajectory prediction, and to output a con- 
trol signal based upon said extended state estimate, said 
predicted extended state estimate, said trajectory and 10 
said trajectory prediction; and 
wherein said extended state of the plant system dynamics is 
adapted to cause an input-output characteristics of the 
plant input-output to appear to be a double-integral plant 
with a scaling factor (b). 15 

2. A controller of claim 1, wherein said prediction state and 
disturbance observer module comprises a system output pre- 
dictor and an extended state observer. 

3. A controller of claim 2, wherein said system output 
predictor predicts a future value of said sensor signal using a 20 
Taylor series approximation. 

4. A controller of claim 2, wherein said control module 
comprises a non-linear control law given by an equation: 


y = uf c e + (L> c e , 

. Vff(R + B|y|) -R 


signCy), hi > R 


<x) c ((x) c e + 2e), 

(R 

gnpdie, e, 0) c ) = \ 

where sign (x) = 


hi - R 


sign(x), h| > R 

\x\<R 


ft 


*>0 
-1, x<0 
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30 


35 


wherein oo c is the frequency of the controller, e is the error, R 
is the maximum control signal, and g rf is said control signal. 

5. A controller of claim 1, wherein said prediction state and 
disturbance observer module comprises a predictive extended 
state observer. 

6. A controller of claim 1, wherein said predictive state and 
disturbance observer module further comprises an observer 
model of the dynamics of the plant. 

7. A controller of claim 1, wherein said control module 
further comprises an additive inverse model of a function (jm) 
that comprises an estimate of the dynamics of the plant and 
external disturbances. 

8. A controller of claim 1, wherein said sensor signal is 
adapted to provide at least a first derivative of said output of 
the plant and said predictive state and disturbance observer 
module comprises a reduced order extended state observer. 

9. A computer-implemented method for controlling a 
plant, comprising: 

measuring an output of the plant to generate a sensed 
output; 

estimating an extended state for the plant using said sensed 
output, comprising a state of the plant and its total dis- 
turbance, wherein said extended state is adapted to cause 
an input-output characteristics of an input-output of the 
plant to appear to be a double-integral plant with a scal- 
ing factor (b); 

predicting a change in the extended state estimate to gen- 
erate a state prediction and an extended state prediction; 

specifying a desired trajectory for an output of the plant to 
follow, wherein said desired trajectory includes a 
desired trajectory and the desired trajectory prediction in 
the future; 

applying a control law to said desired trajectory and said 
desired trajectory prediction, said extended state esti- 
mate, and said extended state prediction; and 

generating a control output. 





